Real-World Decision Support Systems by Jason Papathanasiou Nikolaos Ploskas & Isabelle Linden

Author:Jason Papathanasiou, Nikolaos Ploskas & Isabelle Linden
Language: eng
Format: epub
Publisher: Springer International Publishing, Cham

7.3 Evaluation Support System Requirements Analysis

From the intelligence phase, described in the previous section, we identified three main challenges for assessing any EO challenge: How novel is the submitted candidate’s algorithm?

How good is the computational performance of the method/algorithm?

How does the algorithm perform in terms of precision, accuracy, etc.?

Further, to define the evaluation tree we used several inputs: (a) a questionnaire answered by the teams defining the challenges; (b) existing literature; (c) E-CEO project reports and proposal [5]; (d) several emails exchanged with the consortium domain experts setting up the challenges; (e) and also some bi-lateral teleconferences to clarify some elements to be evaluated. From these inputs, it was possible to define an evaluation tree—encompassing the three identified challenges—with three main branches at the top level, as shown in Fig. 7.3: (a) approach novelty; (b) software performance; (c) and model/algorithm performance. Each branch includes sub-criteria, represented in the 2nd, 3rd, 4th and 5th layers.

Fig. 7.3Evaluation tree decision model

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.